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FOREWORD 


The  research  described  in  this  report  was  performed  in  fiscal  years 
1988  and  1989  as  part  of  an  effort  to  improve  imaging  resolution  from 
incomplete  and  noisy  data.  Maximum  entropy  methods  are  known  to  be 
optimal  in  such  situations;  however,  partly  because  they  are  perceived  to  be 
"difficult  to  understand,"  they  have  not  been  well  used.  It  is  hoped  that  this 
Final  report  will  help  to  remedy  this  situation  by  demonstrating  how  effective 
the  method  can  be  in  several  applied  imaging  problems.  This  effort  was 
supported  by  the  Office  of  Naval  Research,  Code  1247. 
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INTRODUCTION 


In  the  weak  scattcrer  approximation,  the  scattered  field  response  E, 
resulting  from  a  harmonic  excitation  of  a  "target,"  can  be  modeled  by  a 
superposition  of  plane  waves 


(1) 


where  e(r)  is  defined  by  the  local  scattcrer  strength  at  the  position  r,  k  is  the 
propagation  vector  with  magnitude  2j z/X,  and  the  integral  is  over  the  support 
of  the  target  D.  (The  exp(-iait)  time  dependence  has  been  suppressed.) 

In  general,  when  D  is  finite,  E(k)  spans  k-space  and  Equation  1  usually 
cannot  be  uniquely  inverted  to  obtain  the  e(r)  from  a  limited  (finite  and 
discrete)  set  of  scattered  field  measurements.  Moreover,  the  effects  of 
making  assumptions  about  the  unknown  data  (for  example,  that  they  arc 
identically  zero)  distort  the  image  e(r).  However,  since  D  is  already  space- 
limited,  this  equation  can  be  used  as  a  governing  equation  determining  the 
e'(r)  that  is  consistent  with  the  data;  this  can  be  done  by  least-squares 
comparison  between  the  predicted  and  observed  portion  of  the  scattered  field 
(Reference  1). 

In  principle,  when  the  data  are  noise-free  and  a  solution  to  Equation  1 

exists,  this  method  leads  to  an  unambiguous  determination  of  '  e(r)  =  e'(r).  But, 

when  we  account  for  the  inevitable  noise  in  the  measured  data,  we  find 

ourselves  back  to  “best  guessing"  e(r)  from  a  set  of  allowed  images  (e’(r)). 

In  the  following  section,  we  briefly  review  the  principle  of  maximum 
entropy  (maxent)  and  show  how  it  can  be  used  to  select  the  least-biased  image 
from  the  set  of  images  consistent  with  the  measured  data  and  noise.  Then  we 
apply  the  method  to  the  problems  of  (1)  inverse  synthetic  aperture  radar 

(ISAR)  imagery,  for  which  the  phase  part  of  the  scattered  field  is  known  and 
(2)  hot-spot  location  in  ancchoic  chambers,  for  which  the  phase  is  not 
known . 
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MAXIMUM  ENTROPY  SOLUTION 


The  detailed  foundations  of  the  maximum  entropy  principle  have  been 
well  developed  elsewhere;  we  shall  proceed  without  ab  initio  motivation  (cf.. 
References  2  through  8).  The  measured  field  data  will  be  of  the  form 


Mm  =  Em  +  amam 


m  =  1, ....  P 


where  am  is  the  standard  deviation  of  the  measurement  and  am  is  assumed  to 
be  a  mean  zero  (usually  Gaussian)  random  variable  of  unit  variance.  Suppose 
£'(r)  is  a  trial  solution  to  (1)  and  E'  is  the  associated  trial  field,  which  is  to  be 
compared  with  measured  field  data  M.  The  logarithm  of  the  likelihood  of 
observing  a  particular  data  set  from  a  given  e’(r)  gives  the  X2  test  in  the  form 

P 

X2  =  Z  <Mm  -  E'«.)2/°™  ' 

m=l 


This  X2  test  can  be  used  to  define  feasible  solutions.  In  particular,  when  the 
data  are  many,  the  expectation  of  X2  approaches  P  and  our  feasibility 
criterion  becomes  (Reference  9) 


P 

X  (Mm  -  E'm)2/<£  =  P  . 

m=l 


(2) 


The  maximum  entropy  method  allows  us  to  select  from  the  set  of  all 
e’(r)  satisfying  Equation  2,  the  one  that  is  least  biased  based  on  the  data 
(Reference  2).  To  accomplish  this,  wc  form  the  Si-annon-Jayncs  entropy 


S(e)  =  -J  p(r')ln[p(r')ldV'  , 


where 
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1  e(r) ! 

I  e(r')  I  dV’ 


(3) 


The  distribution  e(r),  which  maximizes  S(e)  subject  to  the  constraint  of 
Equation  2,  is  the  maximum  entropy  solution.  This  is  also  the  distribution 
with  the  greatest  degeneracy  (Reference  3). 

If  we  discretize  Equations  1  and  3  by  introducing  the  approximation 
en  =  e(r)  8(r  -  rn),  n  =  then  the  problem  becomes  one  of  constrained 

optimization  over  the  variables  £n.  This  may  be  treated  by  introducing  the 
Lagrange  multiplier  X.  so  that  we  seek  solutions  to  the  simultaneous  system  of 
equations: 


(4) 


where 


Pn  = 


and  Em  is  determined  using 


i. 


N 

Em  =  X  e"  eXP(ikm*rn)  • 

n=l 
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(V  £  denotes  the  vector  operator  VE  =  I ;  Uj  d/deif  where  { u  j }  is  an 
independent  basis  set.) 

The  resulting  N+l  equations  are  nonlinear  in  en  and  in  general  must  be 
solved  iteratively. 


SAMPLE  ISAR  APPLICATION 


For  a  target  with  rotational  position  0  (t)  in  the  far-field  of  the 
transmitter/receiver.  Equation  1  becomes  (Reference  10) 

E(k,0)  =  I  £(x,y)  exp[ik(y  cos  0  -  x  sin  0)]  dx  dy  , 

Jd 

where  k  =  2  x  2 K/X  (the  factor  of  2  accounts  for  the  two-way  travel  distance 

from  transmitter  to  co-located  receiver)  and  now  £(x,y)  represents  the 
integrated  contribution  of  the  scatterer  strengths  along  the  axis  of  rotation. 
If  we  set  ^  =  47t  sin(0)A  and  y  =  -471  cos(0)A,  then  this  equation,  in  its 
discrete  form,  becomes 


R  S 

Eim  =  XX^ exp[-i(xr 4,  +  ys yj]  . 

r=l  s=l 


(5) 


With  this  indexing  scheme,  Equation  4  yields 

£rs  =  exp(p  +  2>.riYrs)  r  =  1, ,  R  ;  s  =  1 . S 

and 


L  M 


1=1  m=l 
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where 


i\  J 

-IX' 

r=l  s=t 


R  S 


P  =  XS^ln(£rs)  - 


r=l  s=  1 


f  L  M 


Yrs  =  Re 


II  (Min,  -  EtaVoJn  exp[i(xr  ^  +  ys  \j/m)] 


1=1  m=l 


and  Eim  are  determined  by  Equation  5. 

All  but  the  last  of  these  equations  are  of  the  form  £rs  =  frs(£)  and  thus 
can  be  solved  by  successive  substitution  (Reference  11)  (i.e.,  if  £^  denotes 
the  ith  iterate,  then  we  set  £rs('  +  1)  =  frs[£(‘)]).  Following  an  observation  by 
Lieu,  we  set  X  =  1/LM  (Reference  12).  For  regularly  spaced  data,  both  E]m  and 
yrs  can  be  determined  by  fast-Fourier  transform  techniques,  and  the  entire 
iterative  process  converges  quite  rapidly  (typically,  within  50  iterations). 

Figure  1  displays  sample  results  of  this  maximum  entropy 
reconstruction.  For  comparison  purposes,  we  have  included  also  the 
reconstruction  obtained  by  windowing  the  data  and  inverse  Fourier 
transforming  the  result.  The  target  consisted  of  two  small  aluminum 
dihedrals  mounted  on  a  rotating  pedestal.  Data  were  collected  using  101 
frequencies  equally  spaced  from  45  to  75  gigahertz  and  discretized  to  32 
angles  from  -2  to  2  degrees  in  aspect.  The  plots  are  logarithmic,  and  the 
maximum  entropy  reconstruction  displays  the  result  of  "ringing,"  or  multiple 
reflections  from  each  dihedral. 

Comparison  between  the  two  reconstructions  demonstrates  the  utility 
in  the  maxent  approach.  Not  only  was  resolution  significantly  increased,  but 
the  sidelobes  present  in  the  inverse  Fourier  transform  result  were  completely 
eliminated  in  the  maximum  entropy  image. 
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FIGURE  1.  Sample  Results:  Two  Dihedrals  Imaged  Using  Ordinary  Fourier  Methods  (a)  and  Maximum  Entropy 
Methods  (b).  Plots  are  logarithmic.  The  multiple  "down  range"  images  are  the  result  of  repeated  target 
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PHASELESS  FOURIER  DATA— ANECHOIC  CHAMBER  DIAGNOSTICS 


The  use  of  anechoic  chambers  for  the  testing  and  evaluation  of 
radiating  systems  has  become  commonplace  in  recent  years.  These  chambers 
allow  for  a  level  of  parameter  control  and  noise  isolation  unparalleled  in 

corresponding  free-space  experiments.  However,  it  has  long  been  known 
that  actual  chambers  cannot  be  expected  to  work  perfectly  and  do  not  always 
correctly  model  free-space.  There  are  usually  spurious  reflections  from  the 
imperfectly  absorbing  walls.  Typically,  these  background  reflections  are 

small — less  than  -30  decibels  of  the  desired  signal.  But  frequently  these 
unwanted  reflections  worsen  as  the  chamber  ages,  and  occasionally  they 
become  significant  enough  to  ruin  the  usefulness  of  the  chamber. 

Considerable  effort  has  been  devoted  to  this  problem,  and  various 
schemes  have  been  proposed  in  the  past  to  characterize  anechoic  chambers 
and  to  try  to  correct  for  their  inherent  limitations  (cf.,  References  13 

through  19).  Mostly,  these  schemes  have  been  ad  hoc  and  ambiguous, 
attempting  to  simply  assign  a  figure  of  merit  to  a  chamber  based  on 
comparison  between  intensity  measurements  and  their  predicted  (free-space) 
values.  In  some  cases,  ray-tracing  methods  have  been  used  to  isolate  specular 
effects  in  the  scattered  field.  While  the  techniques  of  measuring  the  field 
intensity  at  various  locations  within  the  chamber  have  been  well  developed 

(Reference  15),  little  in  the  way  of  systematic  determination  of  the  location  of 
the  background  scatterers  has  been  attempted.  For  many  applications,  the 
effort  may  be  unwarranted.  However,  for  situations  in  which  the  defects  may 
be  corrected,  the  location  problem  is  quite  important. 

The  antenna-pattern  comparison  (APC)  technique  or  the  voltage 
standing-wave  ratio  (VSWR)  technique  allows  for  the  determination  of  the 
ratio  of  the  scattered-to-incident-field  magnitudes  at  various  locations  within 
the  chamber.  Without  loss  of  generality,  we  may  take  the  incident  field  to 
have  unit  magnitude  and  therefore  the  measured  data  will  be  of  the  form 


Mm=  I  Em  I  2  +  “nr  <*m  • 


The  allowed-image  test  is  now 

P 

X(H»-  IeJ’)2/o*=p  , 

m=l 


where  Em  is  calculated  from  Equation  1  for  each  trial  image.  (The  remainder 
of  Equation  4  must  be  similarly  modified.)  All  other  results  follow  as  before. 
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Computer-synthesized  data  were  constructed  for  "known" 
configurations  of  spurious  scatterers.  These  data  consisted  of  intensity  ratios 
at  random  locations  within  the  chamber  with  additive  Gaussian  noise  and  are 
intended  to  represent  the  kind  of  measurements  that  can  be  made  by  VSWR 
techniques.  The  amount  of  noise  was  set  by  choosing  am  =  a  to  be  a  fraction 

of  £max  s  max{en}.  Values  of  o/emax  =  0.001  to  0.05  appear  to  be  consistent  with 
existing  measurement  capabilities  (References  18,  20,  21). 

The  data  were  used  to  exercise  the  algorithm,  and  the  resulting 
reconstruction  was  compared  with  the  known  scatterer  distribution  to  test  for 
accuracy.  Figure  2  illustrates  typical  results  for  a  cubical  test  chamber.  For 
this  reconstruction,  30  measurements  were  "made"  at  random  locations  with 

the  noise  level  set  at  O  =  0.001  £max.  The  resolution  of  this  reconstruction  was 
established  by  dividing  the  walls  into  500  equal  elements. 

The  maximum  entropy  method  is  known  to  be  very  sensitive  to  noise. 
Our  reconstructions  gave  "good"  results  for  a/emax  upto=l%  and  "useful" 
results  for  a/£max  UP  to  ~5%.  Beyond  that  level,  too  little  information  was 
provided  by  the  reconstruction  to  accurately  locate  the  background 
scatterers. 
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Additive  Gaussian  noise  was  included  usir1;  C  =  0.001 
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CONCLUSION 


The  maximum  entropy  method  has  been  applied  to  the  problem  of 
image  reconstruction  from  both  ordinary  and  phaseless  Fourier  data  for 
which  the  standard  deviation  of  the  additive  noise  can  be  estimated  and  is 
small.  For  small  data  sets,  the  results  are  unambiguous  in  the  sense  that  no 
additional  information  about  the  unmeasured  data  are  assumed.  For  this 
reason,  the  reconstructions  are  superior  to  their  usual  Fourier-based 
counterparts. 

The  quality  of  the  reconstructions  comes  with  a  price.  Our 
implementation  of  the  derived  algorithms  typically  ran  more  than  100  times 
slower  than  simple  Fourier  inversion.  Because  of  the  multiple  iterations 
required,  it  is  doubtful  that  significant  improvement  of  this  figure  can  be 
accomplished.  However,  in  situations  where  speed  is  not  the  driving  concern, 
the  quality  of  the  results  may  warrant  the  extra  effort. 
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